Dynamic range converter with frame by frame adaptation and methods for use therewith

ABSTRACT

In various embodiments, a dynamic range converter includes a first color space converter to convert a source color space of a source video having a source dynamic range to nonlinear color space signals. A linearizer configured converts the nonlinear color space signals to linearized color space signals having a mastering dynamic range via a piecewise linear interpolation of a transfer function. A color volume transformer applies dynamic color transform metadata associated with the source video on a frame by frame basis to generate master adjusted color space signals from the linearized color space signals. A delinearizer converts the master adjusted color space signals to nonlinearized color space signals via a piecewise linear interpolation of an inverse transfer function in accordance with a display dynamic range. A second color space converter converts the nonlinearized color space signals to display domain signals. Other embodiments are disclosed.

CROSS REFERENCE TO RELATED PATENTS

The present U.S. Utility patent application claims priority pursuant to35 U.S.C. §120 as a continuation-in-part of U.S. Utility applicationSer. No. 14/863,065, entitled “DYNAMIC RANGE CONVERTER WITH GENERICARCHITECTURE AND METHODS FOR USE THEREWITH”, filed Sep. 23, 2015, whichclaims priority pursuant to 35 U.S.C. §119(e) to U.S. ProvisionalApplication No. 62/101,947, entitled “HDR-SDR COLOR SPACE CONVERSION”,filed Jan. 9, 2015, both of which are hereby incorporated herein byreference in their entirety and made part of the present U.S. Utilitypatent application for all purposes.

TECHNICAL FIELD

The present disclosure relates to audio/video systems that process andpresent audio and/or display video signals.

DESCRIPTION OF RELATED ART

Modern users have many options to view audio/video programming. Homemedia systems can include a television, a home theater audio system, aset top box and digital audio and/or A/V player. The user typically isprovided one or more remote control devices that respond to direct userinteractions such as buttons, keys or a touch screen to control thefunctions and features of the device. Audio/video content is alsoavailable via a personal computer, smartphone or other device. Suchdevices are typically controlled via a buttons, keys, a mouse or otherpointing device or a touch screen.

Video encoding has become an important issue for modern video processingdevices. Robust encoding algorithms allow video signals to betransmitted with reduced bandwidth and stored in less memory. However,the accuracy of these encoding methods face the scrutiny of users thatare becoming accustomed to greater resolution and higher picturequality. Standards have been promulgated for many encoding methodsincluding the H.264 standard that is also referred to as MPEG-4, part 10or Advanced Video Coding, (AVC). While this standard sets forth manypowerful techniques, further improvements are possible to improve theperformance and speed of implementation of such methods. Further,encoding algorithms have been developed primarily to address particularissues associated with broadcast video and video program distribution.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

FIG. 1 presents pictorial diagram representations of various videodevices in accordance with embodiments of the present disclosure.

FIG. 2 presents a block diagram representation of a system in accordancewith an embodiment of the present disclosure.

FIG. 3 presents a block diagram representation of a dynamic rangeconverter in accordance with an embodiment of the present disclosure.

FIG. 4 presents a block diagram representation of alinearizer/delinearizer in accordance with an embodiment of the presentdisclosure.

FIG. 5 presents a graphical representation of a transfer function inaccordance with an embodiment of the present disclosure.

FIG. 6 presents a graphical representation of a log 2 domain transferfunction in accordance with an embodiment of the present disclosure.

FIG. 7 presents a block diagram representation of a color volumetransformer in accordance with an embodiment of the present disclosure.

FIG. 8 presents a block diagram representation of a tone mapper inaccordance with an embodiment of the present disclosure.

FIG. 9 presents a block diagram representation of a color volumetransformer in accordance with an embodiment of the present disclosure.

FIG. 10 presents a graphical representation of clock signals inaccordance with an embodiment of the present disclosure.

FIG. 11 presents a flowchart representation of a method in accordancewith an embodiment of the present disclosure.

FIG. 12 presents a flowchart representation of a method in accordancewith an embodiment of the present disclosure.

FIG. 13 presents a flowchart representation of a method in accordancewith an embodiment of the present disclosure.

DETAILED DESCRIPTION

FIG. 1 presents pictorial diagram representations of various videodevices in accordance with embodiments of the present disclosure. Inparticular, device 10 represents a set top box with or without built-indigital video recorder functionality or a stand-alone digital videoplayer such as an internet video player, Blu-ray player, digital videodisc (DVD) player or other video player. Device 20 represents anInternet tablet. Device 30 represents a laptop, netbook or otherpersonal computer. Device 40 represents a video display device such as atelevision or monitor. Device 50 represents a smartphone, phablet orother mobile communication device. Device 60 represents a streamingvideo player. Device 70 represents a smart watch or other wearablecomputing device with video processing or display functionality. Device80 represents a handheld video camera.

The devices 10, 20, 30, 40, 50, 60, 70 and 80 each represent examples ofelectronic devices that incorporate one or more elements of a system 125that includes features or functions of the present disclosure. Whilethese particular devices are illustrated, system 125 includes any deviceor combination of devices that is capable of performing one or more ofthe functions and features described in conjunction with FIGS. 2-13 andthe appended claims.

FIG. 2 presents a block diagram representation of a system in accordancewith an embodiment of the present disclosure. In an embodiment, system125 receives a video signal 110 and generates a processed video signal112 via encoding into a digital coding or compression format, decodingfrom a digital coding or compression format, transcoding from onedigital coding and compression format to another digital coding orcompression format, etc. The following terms are used:

Luminance: Luminous intensity of a surface in a given direction dividedby the projected area of the surface element as viewed from thatdirection. The units of luminance are candela per square meter (cd/m2).The term luminance as used herein should not to be confused with theterm luminance used in television and video to represent a quantitywhich may more precisely be referred to as “luma”.

Dynamic Range: Ratio of largest to smallest luminance

High Dynamic Range (HDR): A term used to describe an image or imagingdevice that spans or is capable of spanning a range of luminance levelsgreater than the range of luminance levels spanned by traditionalimaging systems. Current standards assume a peak luminance level limitedto 10,000 cd/m².

Standard Dynamic Range (SDR): Peak luminance level commonly defined tobe 100 cd/m²

HDR metadata: Parameters transmitted to define the HDR conversionprocess

Electro-Optical Transfer Function (EOTF): Relationship between thenonlinear color values provided to a display device and the linear colorvalues produced by the device.

Inverse Electro-Optical Transfer Function (IEOTF): Function that isinverse of EOTF.

Perceptual Quantizer (PQ): A quantization method taking advantage of thenonlinear response of the human visual system to reduce the number ofdigital bits to represent an optical signal.

Color value: A number corresponding to the amount of a specific colorcomponent (such as R, G, B, or Y) for an image element. Note that primedesignations (such as R′, G′ and B′) represent nonlinear colorcomponents and non-primed designations (such as R, G and B) representlinear image elements.

Digital code value: Digital representation of an image signal value.Usually representative of a nonlinear color value.

Linear color value: Color Value abbreviated as L, normalized to therange [0,1], that is directly proportional to the optical output of adisplay device, and which is not directly proportional to the encodedsignal representation.

Color volume: Solid in colorimetric space containing all possible colorsa display can produce; defined by the color primaries, white point, andluminance range.

Display primaries: Colors of a display from which all other colors ofsuch display are formed through additive combinations.

Maximum display master luminance: The nominal maximum display luminanceof the mastering display, represented in candelas per square meter(cd/m^2).

Color Space Converter (CSC): A device that operates via a matrixoperation to convert from one color space to another.

Tone mapping: The process of mapping one set of colors to another.

Society of Motion Picture and Television Engineers (SMPTE): Anorganization that promulgates several standards relating to videoprocessing.

Many modern imaging sensors are capable of delivering linear videosignals having dynamic range up to 100 dB, or around 16-bits. This issimilar to the dynamic range of the human visual system, which is about10000:1. Until recently, display panels such as televisions and videomonitors were only capable of dynamic range around 100:1. With theadvent of higher dynamic range panels, the limitation became the lowdynamic range signals supported on the digital interface to the displaypanels. This precipitated the need for a new quantization device thatwould squeeze the high dynamic range signal into fewer bits (8, 10, or12-bits), taking advantage of the nonlinear response of the human visualsystem. Such a Perceptual Quantizer is discussed in conjunction withSMPTE ST 2084 that presents a standardized transfer function that allowshigh dynamic range signals to be quantized and coded.

In addition, the SMPTE ST 2086 standard specifies the metadata items todefine the color volume (the color primaries, white point, and luminancerange) of the display that was used in mastering the video content. Thisinformation could be send with an image or scene to inform a consumerdisplay of the characteristics of the mastering display in order to tuneitself to recreate the mastering artist's intent originally achieved inthe mastering suite. Since ST 2086 is not about dynamic rangeconversion, this standard does not provide enough information to theconsumer display to allow the artist to define how HDR to SDR is to bedown converted.

SMPTE ST 2094 addresses the issue of different display devices. Inparticular, when content mastered with High Dynamic Range (HDR) istransformed for presentation on a display having a smaller color volume,such as Standard Dynamic Range (SDR) display, the color transformationprocess can be optimized through the use of content-dependent, dynamiccolor transform metadata rather than using only display color volumemetadata (as in ST 2086). Different models of color volume transformswith associated metadata sets may require different processingalgorithms and hardware to display the image properly. In ST 2094,provisions are included to support different models, which are calledapplications and detailed in ST 2094-10 (contribution from Dolby), ST2094-20 (Philips), ST 2094-30 (Technicolor), and ST 2094-40 (Samsung).

The system 125 includes a dynamic range converter 150 that, for example,converts an HDR video signal to an SDR video signal and/or providesother dynamic range conversion. For example, the video signal 110 can bereceived via a television receiver, cable television receiver, satellitebroadcast receiver, broadband modem, a Multimedia over Coax Alliance(MoCA) interface, Ethernet interface, local area network transceiver,Bluetooth, 3G or 4G transceiver and/or other information receiver ortransceiver or network interface that is capable of receiving one ormore received signals such as a broadcast video signal, a multicastvideo signal, a unicast video signal, and/or can be generated from astored video file, played back from a recording medium such as amagnetic tape, magnetic disk or optical disk. The video signals 110 caninclude or no include an accompanying audio signal, but video signalsmay include associated dynamic color transform metadata, such asmetadata generated in accordance with SMPTE ST 2094 or other metadatathat can be sued to assist in dynamic range conversion.

The video signal 110 and/or processed video 112 can be uncompresseddigital signals or be a compressed digital video signal complying with adigital video codec standard such as H.264, MPEG-4 Part 10 AdvancedVideo Coding (AVC), VC-1, H.265, or another digital format such as aMotion Picture Experts Group (MPEG) format (such as MPEG1, MPEG2 orMPEG4), QuickTime format, Real Media format, Windows Media Video (WMV)or Audio Video Interleave (AVI), etc. The video signal 110 and/orprocessed video 112 can also include a high definition media interface(HDMI) signal, digital video interface (DVI) signal, a composite videosignal, a component video signal, an S-video signal, and/or be formattedin another video format.

Further details regarding the operation of the dynamic range converter150 including several optional functions and features are presented inconjunction with FIGS. 3-13 that follow.

FIG. 3 presents a block diagram representation of a dynamic rangeconverter in accordance with an embodiment of the present disclosure. Inparticular, an embodiment of dynamic range converter 150 is presentedthat includes color space converters 205 and 235, linearizer 210 anddelinearizer 230, color volume transformer 215, and optional compositor220, color space converter 225, dithering limiter 240 and displayencoder 245. In various embodiments, the color space converters 205 and235, linearizer 210 and delinearizer 230, color volume transformer 215,and optional compositor 220, color space converter 225, ditheringlimiter 240 and display encoder 245 are implemented via a plurality ofcircuits such as a plurality of processing devices. Each processingdevice may be a microprocessor, micro-controller, digital signalprocessor, vector processor, microcomputer, central processing unit,field programmable gate array, programmable logic device, state machine,logic circuitry, digital circuitry, look-up table and/or any device thatmanipulates digital signals based on hard coding of the circuitry and/oroperational instructions.

The circuits that implement the dynamic range converter 150 can beconfigurable based on configuration data 206 to differing color spaces,dynamic ranges including a source dynamic range, mastering dynamicrange, display dynamic range etc., differing standards includingdiffering dynamic color transform metadata formats, differing colorspaces (YCbCr, linear or nonlinear RGB, RGBY, (R−Y), (G−Y), (B−Y),BT.709, BT.601, BT.2020, sRGB, etc.) and other digital formats includinginput and output formats for each functional block, different encodingstandards, frame rates, device resolutions, differing transfer functionsand inverse transfer functions, and configuration of other selectablefunctions and features. In additions, the various individual functionalblocks of dynamic range converter 150 can optionally be enabled ordisabled depending on the requirements of a particular application ofdynamic range converter 150. In addition, the circuits that implementthe dynamic range converter 150 can be configured in a processingpipeline for operation timed by a pixel clock, with dynamic colortransform metadata 206 applied on a frame by frame basis generatedisplay data that reflects the artistic intent for each frame. Inparticular, the circuits that implement the dynamic range converter 150can each include one or more registers or other memory that stores theconfiguration data 206 such as matrix dimensions, matrix coefficients,weighting coefficients, block enable/disable data, look-up table datarepresenting transfer functions and inverse transfer functions and otherconfiguration parameters used to configure the circuit to the particularconversion process currently being run, and in the case of the colorvolume transformer 215, to further store the current dynamic colortransform metadata 202 corresponding to the current or next frame orscene of the source video 200 being processed.

In operation, the color space converter 205 converts a source colorspace of a source video 200, having a source dynamic range, tonon-linear color space signals. The linearizer 210 converts thenon-linear color space signals to linearized color space signals at amastering dynamic range via a piecewise linear interpolation of atransfer function. The transfer function can be an electro-opticaltransfer function as specified in SMPTE ST 2084, another electro-opticaltransfer function, a gamma function of other non-linear compressionfunction. The color volume transformer 215 applies dynamic colortransform metadata 202 associated with the source video 200 to generatemaster adjusted color space signals from the linearized color spacesignals. Optional compositer 220 layers the master color space signalswith further data planes such as layer data 208 and optional color spaceconverter 225 can apply additional color space conversion. Thedelinearizer 230 converts the master adjusted color space signals(optionally composited with one or more video or graphics layers and/orsubjected to additional color conversion) to non-linearized color spacesignals via a piecewise linear interpolation of an inverse of thetransfer function used by linearizer 210 and in accordance with adisplay dynamic range. The color space converter 235 converts thenon-linearized color space signals to display domain signals. Theoptional dithering limiter 240 reduces a number of bits in displaydomain signals to generate video display data and the optional displayencoder 245 generates encoded video display data 250, based on thedisplay data that indicates the display domain signals.

The dynamic range converter 150 can provide a generic and reconfigurablearchitecture to cover a wide variety of HDR standards and proposals. Invarious embodiments, the source dynamic range, mastering dynamic rangeand/or the display dynamic range are each independently configurablebased on the configuration data 206. The shifters of the linearizer 210can convert the source dynamic range of the color components into amastering dynamic range that comports with the dynamic color transformmetadata applied by color volume transformer 215 to recreate theartist's intent. In a similar fashion, shifters of the delinearizer 230can convert the mastering dynamic range of the color components into adisplay dynamic range that, for example, comports with capabilities ofthe display encoder 245 and/or a display device that will reproduce thevideo. In this fashion, the dynamic range converter 150 can selectivelyoperate in a first mode of operation where the source dynamic range is ahigh dynamic range and the display dynamic range is a standard dynamicrange at selectable mastering dynamic range levels.

For example, the dynamic range converter 150 can be programmed tosupport multiple HDR to SDR standard applications such as those proposedin SMPTE working group, “TC-10E DG Dynamic Metadata for Color Transformsof HDR and WCG Images”, and/or an ULTRA HD Blu-ray specification,however, other modes reflecting other source and display dynamic rangesare likewise selectable for implementation based on the configurationdata 206. In addition, the dynamic range converter 150 is capable of SDRto HDR conversion. While there is no proposed standard method fordelivery of SDR plus metadata to an HDR capable display, video can bemastered in HDR and data can be transported that is representative ofSDR frames plus information (via metadata) for up conversion of eachframe to HDR.

Consider an example where dynamic range converter 150 converts 4k/60 fpsHDR source video 200 in the form of 12-bit YCbCr (4:4:4) in the BT.2020color space to SDR encoded display data 250 in the form of 12-bit HDMIdata. After zero-leveling, the HDR data can be represented as 12fractional bits and 1 sign bit. As discussed above, the functionalblocks are pipelines and operate based on a pixel-clock to outputindividual pixels in the converted format, one pixel per clock cycle.The color space converter 205 converts each pixel in the 12-bit YCbCrcolor space of a source video 200 at a source dynamic range of 10Kcd/m², to a corresponding pixel in a 20-bit nonlinear R′G′B′ color spacesignals via a 3×3 matrix operation. In particular, each individuallinear color value of each pixel is proportional to the luminance value,where 1.0 corresponds to reference luminance, Lref, of 10K cd/m² definedto be 10,000 cd/m^2 in ST 2084.

The linearizer 210 the 20-bit nonlinear R′G′B′ color space signals to20-bit linear RGB color space signals via a piecewise linearinterpolation of the EOTF transfer function specified by SMPTE ST 2084and shifts the data to a mastering dynamic range, Lmastering, of 5Kcd/m². By, for example, scaling the linear color values byLmastering/Lref (0.5 in this case) and then saturating or otherwisenormalizing to 1.0 to result in a reduction in the dynamic range ifLmastering<Lref. This reduced dynamic range matches the dynamic range inmastering.

The color volume transformer 215 applies dynamic color transformmetadata 202 in accordance with SMPTE ST 2094 associated with the sourcevideo 200, on a frame by frame basis, to generate master adjusted colorspace signals in 20-bit RGB. Color volume transforms are applied torecreate the mastering artist's intent, using metadata generated by theartist for each frame or scene, to prepare the image for dynamic rangecompression.

Optional compositer 220 layers the master color space signals withfurther graphics and video planes and optional color space converter 225applies additional color space conversion to convert to 20-bit RGB via a3×3 matrix operation. The delinearizer 230 operates via a piecewiselinear interpolation of an inverse EOTF transfer function specified bySMPTE ST 2084 to generate 20-bit nonlinear R′G′B′ and shifts the data toa display dynamic range, Ldisplay, of 100 cd/m² via a scaling byLdisplay/Lmastering and saturation or other normalizing back to 1.0. Thecolor space converter 235 converts to 20-bit Y′Cb′Cr′ via a 3×3 matrixoperation. The dithering limiter 240 reduces a number of bits in displaydomain signals to generate 12-bit Y′Cb′Cr′ video display data and thedisplay encoder 245 generates HDMI encoded video display data 250.

Consider an example where the video signal has 4096×2160 (4k) resolutionand is 60 fps with a frame time of 16.7 ms. The architecture canimplement low-latency dynamic range conversion. In various embodiments,the latency can be 0.5 seconds or less or very low latency such as 200msec or less.

FIG. 4 presents a block diagram representation of alinearizer/delinearizer in accordance with an embodiment of the presentdisclosure. In particular linearizer/delinearizer 300 includes a look-uptable that converts an input signal into a log 2 domain signal anddetermines a slope and intercept based on a piecewise linearrepresentation of a particular log 2 domain transfer function that isprogrammable based on configuration data 206. An adder and a multipliergenerate an interpolated result by interpolating the log 2 domain signalbased on the slope and intercept. The look-up table generates an outputsignal based on an inverse log 2 conversion of the interpolated resultthat can be shifted to scale the output to a desired dynamic range. Theuse of log 2 based lookup tables can result in a smaller silicon areaand less error (than linear tables), particularly when a nonlineartransfer function is logarithmic or substantially algorithmic.

Considering the example shown, a linearizer/delinearizer 300 ispresented that can function as linearizer 210 and/or delinearizer 230presented in conjunction with FIG. 3. Color space signals 310, such asnonlinear R′G′B′ color components in the case of linearizer 210 orlinear RGB color components in the case of delinearizer 230, areconverted to transformed colors space signals 312 having linear ornon-linear color components as the case may be. The color component x ofthe color space signals 310 are converted to log 2 domain via log 2look-up tables 302. Consider the case where a transfer function f(x)(including an inverse transfer function) is implemented, in the log 2domain, the x is converted to log 2(x), a different function f′ isemployed where:f′(a)=log 2(f(a))

Since the color space signals 310 have the range [0,1], the log 2 domainconversion results in a log 2 value x for each color component in therange [−xmax,0], where −xmax is the largest negative number that can berepresented based on the number of bits in the signal. An optional modeselect 301 determines one of a plurality of modes to apply based on thevalue of x. For example, in the normal case, the value of x itself isconverted to log 2(x) used to determine f′ (log 2(x)) based on atransfer function interpolator 304 that uses a piecewise linearapproximation of a log 2 domain transformation the particular transferfunction to generate a corresponding slope, m, and y-intercept, b, ofthe piece-wise linear function that corresponds to the value of log2(x). The transfer function interpolator 304 calculates the value of:y=f′(log 2(x))=m(log 2(x))+b.In this normal mode, transfer function interpolators 304 generateintercept and slope values indexed by the value of log 2(x) and uses anadder and multiplier to generate the value of f(log 2(x)) in the log 2domain for inverse log 2 conversion by invlog 2 look-up tables 306.

In cases where x is greater than a predetermined or programmablethreshold T1, such as when x is close to 1, the mode select 301 canselect a reverse mode where x′=1−x is used instead. This is useful inthe case where the transfer function in the log 2 domain does not wellfor values near 1.0 where there is less resolution. In this case,transfer function interpolators 304 use a look-up of slope and interceptbased on:y=f(log 2(x′))=m(log 2(x′))+b.

In cases where the value of x is smaller than a programmable thresholdT2, such as when x is close to 0, the mode select 301 can select abypass mode that calculates the output directly based on apre-determined slope m₀ and intercept b₀. This is useful in the casewhere the transfer function f(x) is highly linear in the region where xis close to 0. In particular, the log 2 conversion, log 2 domaininterpolation and inverse log conversion can be bypassed and the outputvalue can be calculated directly as:y=m ₀ x+b ₀.

As shown, range shifters 308 are programmable based on configurationdata 206 to scale the dynamic range of the transform color space signals312. For example, the range shifters 308 can scale the dynamic range atthe input from Lref to Lmaster in the case of linearizer 210, or at theoutput from Lmaster to Ldisplay, in the case of delinearizer 230.

FIG. 5 presents a graphical representation 380 of a transfer function inaccordance with an embodiment of the present disclosure and FIG. 6presents a graphical representation 390 of a log 2 domain transferfunction in accordance with an embodiment of the present disclosure. Inparticular, the transfer function 382 represents the EOTF as defined inST 2084, while transfer function 392 represented the EOTF in the Log 2domain, on a log 2-log 2 scale. When implementing the EOTF function witha piecewise linear lookup table, the table memory contains a fixednumber of pieces, or words, delineated by the dark circles on the graph,with corresponding y-intercept and slope values stored as fixed-pointintegers. In particular, highly linear regions of the function can beimplemented via longer segments than regions that are less linear, whilemaintaining relatively similar error bounds. While a number dark circlesare shown that delineate a number of segments, greater or fewer segmentscan likewise be implemented.

The log 2-domain transfer function is appealing in this implementationbecause: a) the plot looks substantially linear which lends itself wellto the interpolation between fewer segments; b) the values ofy-intercept and slope can fit in to a smaller number of bits whenrepresented by fixed-point integers; and c) one programmable table, suchas a 64×32 RAM can be used for all the converter's lookup tablesproviding a great variability of transfer functions through softwarereconfiguration.

FIG. 7 presents a block diagram representation of a color volumetransformer in accordance with an embodiment of the present disclosure.In particular an implementation of color volume transformer 215 is shownimplemented by a series of blocks that can each be implemented by acorresponding circuit in a color volume transform path 360. The blocksin the color volume transform path 360 can be configured in a pipelinedconfiguration and clocked, based on a pixel clock, to produce one pixeloutput per cycle of the pixel clock. Not only are the blocks of in thecolor volume transform path 360 independently configurable based onconfiguration data 206, they are also programmable according to thedynamic color transform metadata 202 that is associated with the sourcevideo.

In various embodiments, the color volume transformer 215 applies gamutshaping, luminance tone mapping, chrominance tone mapping and/oradditional color space conversion to generates transformed color spacesignals 332 from color space signals 330. In operation, the gamut shaper320 applies gamut shaping to linearized color space signals inaccordance with the dynamic color transform metadata 202 to generategamut shaped components. The tone mapper 322 applies chrominance tonemapping by scaling the gamut shaped components in accordance with thedynamic color transform metadata 202 to generate chrominance mappedcomponents. A color remapper 324 color converts the chrominance mappedcomponents in accordance with the dynamic color transform metadata 202to generate color remapped components. The tone mapper 326 appliesluminance tone mapping by scaling the color remapped components inaccordance with the dynamic color transform metadata 202 to generateluminance mapped components. The color space converter 328 colorconverts the luminance mapped components in accordance with the dynamiccolor transform metadata 202 to generate transform color space signals312 that are master adjusted to the intent of the artist.

The gamut shaper 320, color remapper 324 and color space converter 328as well as the tone mappers 322 and 326 can each be implemented viacircuits such as a processing device. Each processing device may be amicroprocessor, micro-controller, digital signal processor, vectorprocessor, microcomputer, central processing unit, field programmablegate array, programmable logic device, state machine, logic circuitry,digital circuitry, look-up table and/or any device that manipulatesdigital signals based on hard coding of the circuitry and/or operationalinstructions.

In particular, the circuits that implement the color volume transformer215 can be configurable based on configuration data 206 to differingcolor spaces, dynamic ranges including a source dynamic range, andmastering dynamic range, differing standards including differing dynamiccolor transform metadata formats, differing color spaces (YCbCr, linearor nonlinear RGB, RGBY, (R−Y), (G−Y), (B−Y), BT.709, BT.601, BT.2020,sRGB, etc.) and configuration of other selectable functions andfeatures. In addition, the circuits that implement the color volumetransformer 215 can be configured in a processing pipeline for operationtimed by a pixel clock, with dynamic color transform metadata 206applied on a frame by frame basis to generate transform color spacesignals 332 that reflect the artistic intent for each frame. Inparticular, the circuits that implement the color volume transformer 215can each include one or more registers or other memory that stores theconfiguration data 206 such as matrix dimensions and look-up table datarepresenting log 2 and inverse log 2 conversions and other configurationparameters used to configure the circuits to the particular conversionprocess currently being run, and further to store the dynamic colortransform metadata 202 such as matrix coefficients, weightingcoefficients, and other dynamic color transform metadata 202corresponding to the current or next frame or scene of the source video200 being processed.

For example, the color space signals 330 can be 20-bit RGB signals. Thegamut shaper 320 can include a color space converter that performs a 4×4matrix conversion to generate gamut shaped color components in 20-bitRGBY format that are chrominance tone mapped by tone mapper 322 togenerate chrominance mapped components in 20-bit RGBY format. The colorremapper 324 can include a color space converter that performs a 4×4matrix conversion to generate 20-bit RGBY color remapped components thatare luminance tone mapped by tone mapper 326 to generate tone mappedcomponents in 20-bit RGBY format. The color space converter 328 canperform a 3×4 matrix conversion to generate the transform color spacesignals 332 in RGB format. The use of 4×4 and 3×4 matrices allow thevarious blocks to operate based on linear combinations of (R, G, B, Y)in one configuration set by configuration data 206. In otherconfigurations, difference signals such as (R−Y), (G−Y), (B−Y) or 3×3matrix operations with (R, G, B) can likewise be used. Further detailsregarding the operation of tone mapper 322 and 326 including severaloptional functions and features are presented in conjunction with FIG. 8that follows.

FIG. 8 presents a block diagram representation of a tone mapper inaccordance with an embodiment of the present disclosure. In particular atone mapper 322 or 326 is presented that includes weighting module 342,mode select 344, log 2 look-up tables 346 and 354, transfer functioninterpolator 348, adders 356 and inverse log 2 look-up table 354. Thetone mapper converts color space signals 350 into tone mapped colorspace signals 352, for example, in formats described in conjunction withFIG. 7.

The tone mapper 322 or 326 can be set in either a scale mode or atranslate mode based on the configuration data 206 or dynamic colortransform metadata 202. In a chrominance tone mapper implementation(tone mapper 322) that is set in a scale mode, the weighting module 342generates a weighted maximum of gamut shaped components in formats (suchas R, G, B and Y) specified by the dynamic color transform metadata 202and further based on weighting coefficients established by the dynamiccolor transform metadata 202. The mode select 344, log 2 look-up table346 and transfer function interpolator 348 operate in a similar fashionto mode select 301, log 2 look-up table 302 and transfer functioninterpolator 304, to obtain a scale factor for each of the gamut shapedcomponents.

In a normal mode of operation set by mode select 344 (in the scalemode), the value of the weighted maximum in the log 2 domain is used asan index in three chrominance mapping tables programmed in response tothe dynamic color transform metadata to reflect the artist's intent, onefor each of the color components (such as R, G and B). Slope andy-intercept values for each of the three components are used to generatethese three scale factors. Reverse mode (in the scale mode can beimplemented), as previously discussed, by mode select 344 for values ofthe weighted maximum close to 1. The resulting scale factors in the log2 domain are added by adders 356 to log 2 domain values of the colorcomponents (such as R, G and B) that are generated by log 2 look-uptable 354. Adding these values in the log 2 domain operates asmultiplication to generate scaled gamut shaped components. Inverse log 2look-up table 356 generates the chrominance mapped components by inverselog 2 conversion of the scaled gamut shaped components.

When the translate mode is set based on the configuration data 206 ordynamic color transform metadata 202, the weighting module 342, log 2look-up table 354 and adders 356 are bypassed and the gamut shaped colorcomponents (such as R, G and B) in the log 2 domain are directlytranslated by the transfer function interpolator 348 based oncorresponding tables that are programmed in response to the dynamiccolor transform metadata 202 to reflect the artist's intent. In the casethe transfer function interpolator directly generates the chrominancemapped components in the log 2 domain.

In addition to configuration to scale or translate mode as discussedabove, the tone mapper 322 or 326 can be configurable based onconfiguration data 206 to differing mastering dynamic ranges, differingcolor spaces (RGB, RGBY, (R−Y), (G−Y), (B−Y)) and other differingconfigurations that implement other selectable functions and features.

In a luminance tone mapper implementation, the components of the tonemapper 326 are implemented similarly to generate transform color spacesignals 352 in the form of luminance mapped components in response tocolor space signals 350 in the form of color remapped components. Inparticular, the transfer function interpolator 348 implements threeluminance mapping tables that are programmed in response to the dynamiccolor transform metadata 202 to reflect the artist's intent.

FIG. 9 presents a block diagram representation of a color volumetransformer in accordance with an embodiment of the present disclosure.As discussed in conjunction with FIG. 7, the circuits that implement thecolor volume transform path 360 of the color volume transformer 215 canbe configured in a processing pipeline for operation timed by a pixelclock to produce one pixel output per cycle of the pixel clock 366. Inaddition, the dynamic color transform metadata 202 can be applied on aframe by frame basis to generate transform color space signals 332 thatreflect the artistic intent for each frame. The pixel and frame clockgenerator 362 is provided to generate the pixel clock and a frame clockbased on configuration data that indicates, for example, the frame rate,the number of pixels per frame and/or other timing information.

In various embodiments, the circuits in the color volume transform path360 can each include a plurality of registers that store theconfiguration data 206 and the dynamic color transform metadata 202. Asshown, gamut mapper 320 includes registers 500, tone mapper 322 includesregisters 502, color remapper 324 includes registers 504, tone mapper326 includes registers 506 and color space converter 328 includesregisters 508. Any of the registers 500, 502, 504, 506 and 508 can beimplemented by a processor register, cache, buffer memory or othermemory that stores the configuration data 206 and dynamic colortransform metadata 202. In this fashion, configuration data 206, such asmatrix dimensions and look-up table data representing log 2 and inverselog 2 conversions and other configuration parameters can be stored inthe corresponding circuits that use this data, to configure each circuitto the particular conversion process currently being run. In addition,the registers or other memory can further store the dynamic colortransform metadata 202 such as matrix coefficients, weightingcoefficients, and other dynamic color transform metadata 202 incorresponding circuits to conform with the current or next frame orscene of the source video 200 being processed. The registers that storethe dynamic color transform metadata 202 for each frame can be shadowedand swapped at frame boundaries to facilitate the frame by frameprocessing.

In various embodiments, in a time period where an (n−1)^(st) video frameis being processed by the color volume transformer 215, the color volumetransformer 215 loads the dynamic color transform metadata 202associated with an n^(th) video frame of the source video 200 in firstones of the registers 500, 502, 504, 506 and 508. During the next timeperiod, the color volume transformer 215 processes the n^(th) videoframe using the dynamic color transform metadata 202 associated with then^(th) frame of the source video loaded in the first ones of theregisters 500, 502, 504, 506 and 508. During that same time periodwherein the n^(th) video frame is being processed, the color volumetransformer 215 loads the dynamic color transform metadata 202associated with the (n+1)^(st) video frame of the source video in secondones of the registers 500, 502, 504, 506 and 508. During the next timeperiod, the color volume transformer 215 processes the (n+1)^(st) videoframe using the dynamic color transform metadata 202 associated with the(n+1)^(st) frame of the source video loaded in the second ones of theregisters 500, 502, 504, 506 and 508. During that same time periodwherein the (n+1)^(st) video frame is being processed, the color volumetransformer 215 loads the dynamic color transform metadata 202associated with a (n+2)^(nd) frame of the source video in first ones ofthe registers 500, 502, 504, 506 and 508, etc.

In this fashion, two sets of registers for each circuit can bealternatively loaded when not in use and swapped back and forth at theboundary of each successive frame as required to meet the needs of theprocessing of the current video frame. In particular, the frame boundarycan be determined based on processing of the last pixel of each frame asindicated based on a frame clock 364 or a counter based on the pixelclock. Because the circuits of color volume transformer 215 areconfigured in a processing pipeline for operation timed by the pixelclock to produce one pixel output per cycle of the pixel clock, theframe boundary appears for each circuit at staggered times in accordancewith the pipelined configuration. In particular, each circuit swapsregisters when the frame boundary occurs for that circuit—at the timeprocessing of the last pixel of the prior frame is complete andprocessing of the first pixel of the next frame is about to begin.

For example, consider the case where there are p pixels in a frame. Ifthe color space converter 328 is processing the pixel p (correspondingto the last pixel in a frame), tone mapper 326 is processing pixel p−1,color remapper 324 is processing pixel p−2, tone mapper 322 isprocessing pixel p−3 and gamut shaper 320 is processing pixel p−4. Atthe next cycle of the pixel clock, the color space converter 328 crossesthe frame boundary and swaps registers 508 to begin using the dynamiccolor transform metadata 202 for the new frame to process the pixel 1(the first pixel in the new frame). At this same time, the tone mapper326 processes pixel p of the prior frame, color remapper 324 processespixel p−1 of the prior frame, tone mapper 322 processes pixel p−2 of theprior frame and gamut shaper 320 processes pixel p−3 of the prior frame.At the next cycle of the pixel clock, the color space converter 328processes pixel 2 of the new frame, the tone mapper 326 crosses theframe boundary and swaps registers 506 to begin using the dynamic colortransform metadata 202 of the new frame to begin processing of the pixel1 of the new frame, color remapper 324 processes pixel p of the priorframe, tone mapper 322 processes pixel p−1 of the prior frame and gamutshaper 320 processes pixel p−2 of the prior frame, etc. It should benoted that the foregoing is merely one example of possibleimplementations and in further that one or more blocks in the processingpipeline can include one or more functions that operate in sub-pixeltime.

FIG. 10 presents a graphical representation of clock signals inaccordance with an embodiment of the present disclosure. In particular,examples of frame clock 364 and pixel clock 366 are presented. In theembodiment shown, the pixel clock 366 has a number of pixel clock cyclesfor each frame duration corresponding to the number of pixels in eachframe. The frame clock 364 shown has two states, each having a durationthat corresponds to the duration of a single frame.

As discussed in conjunction with FIG. 9, a pixel and frame clockgenerator can generate the pixel clock 366 and frame clock 364 based onconfiguration data 206 that indicates, for example, the frame rate, thenumber of pixels per frame and/or other timing information. Whileparticular examples of the pixel clock 366 and frame clock 364 areshown, it should be noted that in other embodiments, a frame clock thathas a single clock cycle per frame can likewise be implemented. Further,while a single frame clock 364 is shown, a plurality of staggered frameclocks can be used, each timed to correspond to the frame boundary ofone of the circuits of color volume transformer 215 in the processingpipeline.

FIG. 11 presents a flowchart representation of a method in accordancewith an embodiment of the present disclosure. In particular, a method ispresented for use with one or more functions and features discussed inconjunction with FIGS. 1-10. Step 400 includes converting a source colorspace of a source video having a source dynamic range to nonlinear colorspace signals. Step 402 includes converting the nonlinear color spacesignals to linearized color space signals having a mastering dynamicrange via a piecewise linear interpolation of a transfer function. Step404 includes color volume transforming the linearized color spacesignals on a frame by frame basis, based on dynamic color transformmetadata associated with the source video, to generate master adjustedcolor space signals. Step 406 includes delinearizing the master adjustedcolor space signals to nonlinearized color space signals via a piecewiselinear interpolation of an inverse transfer function in accordance witha display dynamic range. Step 408 includes converting the nonlinearizedcolor space signals to display domain signals.

In various embodiments, the color volume transforming includes: loadingin a plurality of first registers prior to a first time period, thedynamic color transform metadata associated with a first video frame ofthe source video; processing first frame data corresponding to the firstvideo frame of the source video during the first time period using thedynamic color transform metadata associated with the first video frameof the source video loaded in the plurality of first registers; loadingin a plurality of second registers during the first time period, thedynamic color transform metadata associated with a second video frame ofthe source video; processing second frame data corresponding to thesecond video frame of the source video during a second time period thatis after the first time period, using the dynamic color transformmetadata associated with the second video frame of the source videoloaded in the plurality of second registers; and loading in theplurality of first registers during the second time period, the dynamiccolor transform metadata associated with a third video frame of thesource video.

The color volume transforming can switch from processing of the videodata corresponding to the first video frame of the source video toprocessing of the video data corresponding to the second video frame ofthe source in response to frame boundary. In addition, the color volumetransforming van operate via a plurality of circuits in a pipelinedconfiguration under control of a pixel clock, and the frame boundary canbe determined based on processing of the last pixel of the first frame.A plurality of circuits used in the color volume transforming can beswitched from processing of the video data corresponding to the firstvideo frame of the source video to processing of the video datacorresponding to the second video frame of the source video in responseto the frame boundary at staggered times in accordance with thepipelined configuration.

In various embodiments, the method includes configuring at least oneconfigurable circuit based on configuration data, to perform any of thesteps 400, 402, 404, 406 or 408. The configuration data can indicate thesource dynamic range, the master dynamic range and the display dynamicrange. The transfer function can be configured based the configurationdata as one of: an electro-optical transfer function or a gamma functionand the inverse transfer function is configured based the configurationdata as a corresponding one of: an inverse of the electro-opticaltransfer function or an inverse of the gamma function. The color volumetransforming can apply luminance tone mapping and chrominance tonemapping in accordance with a color component space indicated by theconfiguration data. The color volume transforming can apply gamutshaping, color remapping and additional color space conversion inaccordance with a color component space indicated by the configurationdata.

In various embodiments, the method can include controlling a pluralityof circuits in a processing pipeline via a pixel clock that implementsone or more of the steps 400, 402, 404, 406 and 408. Each of theplurality of circuits can output a pixel at a rate of one pixel perclock cycle of the pixel clock. The processing pipeline can furtherinclude layering the master color space signals with further data planesprior to delinearizing and/or color converting the master color spacesignals prior to prior to delinearizing. The color volume transformingcan include: applying gamut shaping to the linearized color spacesignals in accordance with the dynamic color transform metadata togenerate gamut shaped components; applying chrominance tone mapping byscaling the gamut shaped components in accordance with the dynamic colortransform metadata to generate chrominance mapped components; colorconverting the chrominance mapped components in accordance with thedynamic color transform metadata to generate color remapped components;applying luminance tone mapping by scaling the color remapped componentsin accordance with the dynamic color transform metadata to generateluminance mapped components; and color converting the luminance mappedcomponents in accordance with the dynamic color transform metadata togenerate the master adjusted color space signals.

FIG. 12 presents a flowchart representation of a method in accordancewith an embodiment of the present disclosure. In particular, a method ispresented for use with one or more functions and features discussed inconjunction with FIGS. 1-11. Step 410 includes converting a source colorspace of a source video having a source dynamic range to nonlinear colorspace signals. Step 412 includes converting the nonlinear color spacesignals to linearized color space signals having a mastering dynamicrange via a piecewise linear interpolation of a transfer function. Step414 includes color volume transforming the linearized color spacesignals based on dynamic color transform metadata associated with thesource video to generate master adjusted color space signals. Step 416includes delinearizing the master adjusted color space signals tononlinearized color space signals via a piecewise linear interpolationof an inverse transfer function in accordance with a display dynamicrange. Step 418 includes converting the non to nonlinearized color spacesignals to display domain signals.

The method can further include layering the master color space signalswith further data planes prior to delinearizing and/or color convertingthe master color space signals prior to prior to delinearizing. Thecolor volume transforming can include: applying gamut shaping to thelinearized color space signals in accordance with the dynamic colortransform metadata to generate gamut shaped components; applyingchrominance tone mapping by scaling the gamut shaped components inaccordance with the dynamic color transform metadata to generatechrominance mapped components; color converting the chrominance mappedcomponents in accordance with the dynamic color transform metadata togenerate color remapped components; applying luminance tone mapping byscaling the color remapped components in accordance with the dynamiccolor transform metadata to generate luminance mapped components; andcolor converting the luminance mapped components in accordance with thedynamic color transform metadata to generate the master adjusted colorspace signals.

FIG. 13 presents a flowchart representation of a method in accordancewith an embodiment of the present disclosure. In particular, a method ispresented for use with one or more functions and features discussed inconjunction with FIGS. 1-11. Step 420 includes operating a logarithmbase 2 (log 2) domain circuit that uses piecewise linear interpolationto perform at least one of: converting nonlinear color space signals tolinearized color space signals; converting linear color space signals tononlinearized color space signals; scaling gamut shaped components inaccordance with dynamic color transform metadata to generate chrominancemapped components; or scaling color remapped components in accordancewith the dynamic color transform metadata to generate luminance mappedcomponents.

In various embodiments, the log 2 domain circuit is further operated toscale the dynamic range of at least one of: an input signal of the log 2domain circuit or an output signal of the log 2 domain circuit. Theinput signal x can represent a positive value less than 1 and whereinfor values of x greater than T, the log 2 domain circuit can operate ina reverse mode based on 1−x. The operations of the log 2 domain circuitfurther include converting an input signal into a log 2 domain signal;determining a slope and intercept based on a piecewise linearrepresentation of a log 2 domain transfer function; generating aninterpolated result by interpolating the log 2 domain signal based onthe slope and intercept; and generating an output signal based on aninverse log 2 conversion of the interpolated result.

In various embodiments, the log 2 domain transfer function can representone of: an electro-optical transfer function, a gamma function, aninverse electro-optical transfer function or an inverse gamma function.The operations of the log 2 domain circuit can further include:generating a weighted maximum of the gamut shaped components, based onthe dynamic color transform metadata; obtaining a scale factor for thegamut shaped components based on the log 2 domain circuit; multiplyingthe scale factor by corresponding ones of the gamut shaped components togenerate scaled gamut shaped components; and generating the chrominancemapped components via an inverse log 2 conversion of the scaled gamutshaped components. The operations of the log 2 domain circuit canfurther include: generating a weighted maximum of the color remappedcomponents, based on the dynamic color transform metadata; obtaining ascale factor for the color remapped components based on the log 2 domaincircuit; and multiplying the scale factor by corresponding ones of thecolor remapped components to generate scaled color remapped componentsand generating the luminance mapped components via an inverse log 2conversion of the scaled color remapped components.

As may also be used herein, the term(s) “configured to”, “operablycoupled to”, “coupled to”, and/or “coupling” includes direct couplingbetween items and/or indirect coupling between items via an interveningitem (e.g., an item includes, but is not limited to, a component, anelement, a circuit, and/or a module) where, for an example of indirectcoupling, the intervening item does not modify the information of asignal but may adjust its current level, voltage level, and/or powerlevel. As may further be used herein, inferred coupling (i.e., where oneelement is coupled to another element by inference) includes direct andindirect coupling between two items in the same manner as “coupled to”.As may even further be used herein, the term “configured to”, “operableto”, “coupled to”, or “operably coupled to” indicates that an itemincludes one or more of power connections, input(s), output(s), etc., toperform, when activated, one or more its corresponding functions and mayfurther include inferred coupling to one or more other items. As maystill further be used herein, the term “associated with”, includesdirect and/or indirect coupling of separate items and/or one item beingembedded within another item.

As may also be used herein, the terms “processing module”, “processingcircuit”, “processor”, and/or “processing unit” may be a singleprocessing device or a plurality of processing devices. Such aprocessing device may be a microprocessor, micro-controller, digitalsignal processor, microcomputer, central processing unit, fieldprogrammable gate array, programmable logic device, state machine, logiccircuitry, analog circuitry, digital circuitry, and/or any device thatmanipulates signals (analog and/or digital) based on hard coding of thecircuitry and/or operational instructions. The processing module,module, processing circuit, and/or processing unit may be, or furtherinclude, memory and/or an integrated memory element, which may be asingle memory device, a plurality of memory devices, and/or embeddedcircuitry of another processing module, module, processing circuit,and/or processing unit. Such a memory device may be a read-only memory,random access memory, volatile memory, non-volatile memory, staticmemory, dynamic memory, flash memory, cache memory, and/or any devicethat stores digital information. Note that if the processing module,module, processing circuit, and/or processing unit includes more thanone processing device, the processing devices may be centrally located(e.g., directly coupled together via a wired and/or wireless busstructure) or may be distributedly located (e.g., cloud computing viaindirect coupling via a local area network and/or a wide area network).Further note that if the processing module, module, processing circuit,and/or processing unit implements one or more of its functions via astate machine, analog circuitry, digital circuitry, and/or logiccircuitry, the memory and/or memory element storing the correspondingoperational instructions may be embedded within, or external to, thecircuitry comprising the state machine, analog circuitry, digitalcircuitry, and/or logic circuitry. Still further note that, the memoryelement may store, and the processing module, module, processingcircuit, and/or processing unit executes, hard coded and/or operationalinstructions corresponding to at least some of the steps and/orfunctions illustrated in one or more of the Figures. Such a memorydevice or memory element can be included in an article of manufacture.

One or more embodiments have been described above with the aid of methodsteps illustrating the performance of specified functions andrelationships thereof. The boundaries and sequence of these functionalbuilding blocks and method steps have been arbitrarily defined hereinfor convenience of description. Alternate boundaries and sequences canbe defined so long as the specified functions and relationships areappropriately performed. Any such alternate boundaries or sequences arethus within the scope and spirit of the claims. Further, the boundariesof these functional building blocks have been arbitrarily defined forconvenience of description. Alternate boundaries could be defined aslong as the certain significant functions are appropriately performed.Similarly, flow diagram blocks may also have been arbitrarily definedherein to illustrate certain significant functionality.

To the extent used, the flow diagram block boundaries and sequence couldhave been defined otherwise and still perform the certain significantfunctionality. Such alternate definitions of both functional buildingblocks and flow diagram blocks and sequences are thus within the scopeand spirit of the claims. One of average skill in the art will alsorecognize that the functional building blocks, and other illustrativeblocks, modules and components herein, can be implemented as illustratedor by discrete components, application specific integrated circuits,processors executing appropriate software and the like or anycombination thereof.

In addition, a flow diagram may include a “start” and/or “continue”indication. The “start” and “continue” indications reflect that thesteps presented can optionally be incorporated in or otherwise used inconjunction with other routines. In this context, “start” indicates thebeginning of the first step presented and may be preceded by otheractivities not specifically shown. Further, the “continue” indicationreflects that the steps presented may be performed multiple times and/ormay be succeeded by other by other activities not specifically shown.Further, while a flow diagram indicates a particular ordering of steps,other orderings are likewise possible provided that the principles ofcausality are maintained.

The one or more embodiments are used herein to illustrate one or moreaspects, one or more features, one or more concepts, and/or one or moreexamples. A physical embodiment of an apparatus, an article ofmanufacture, a machine, and/or of a process may include one or more ofthe aspects, features, concepts, examples, etc. described with referenceto one or more of the embodiments discussed herein. Further, from figureto figure, the embodiments may incorporate the same or similarly namedfunctions, steps, modules, etc. that may use the same or differentreference numbers and, as such, the functions, steps, modules, etc. maybe the same or similar functions, steps, modules, etc. or differentones.

Unless specifically stated to the contra, signals to, from, and/orbetween elements in a figure of any of the figures presented herein maybe analog or digital, continuous time or discrete time, and single-endedor differential. For instance, if a signal path is shown as asingle-ended path, it also represents a differential signal path.Similarly, if a signal path is shown as a differential path, it alsorepresents a single-ended signal path. While one or more particulararchitectures are described herein, other architectures can likewise beimplemented that use one or more data buses not expressly shown, directconnectivity between elements, and/or indirect coupling between otherelements as recognized by one of average skill in the art.

The term “module” is used in the description of one or more of theembodiments. A module implements one or more functions via a device suchas a processor or other processing device or other hardware that mayinclude or operate in association with a memory that stores operationalinstructions. A module may operate independently and/or in conjunctionwith software and/or firmware. As also used herein, a module may containone or more sub-modules, each of which may be one or more modules.

While particular combinations of various functions and features of theone or more embodiments have been expressly described herein, othercombinations of these features and functions are likewise possible. Thepresent disclosure is not limited by the particular examples disclosedherein and expressly incorporates these other combinations.

What is claimed is:
 1. A dynamic range converter comprising: a firstcolor space converter configured to convert a source color space of asource video having a source dynamic range to nonlinear color spacesignals; a linearizer configured to convert the nonlinear color spacesignals to linearized color space signals having a mastering dynamicrange via a piecewise linear interpolation of a transfer function; acolor volume transformer configured to apply dynamic color transformmetadata associated with the source video on a frame by frame basis togenerate master adjusted color space signals from the linearized colorspace signals; a delinearizer configured to convert the master adjustedcolor space signals to nonlinearized color space signals via a piecewiselinear interpolation of an inverse transfer function in accordance witha display dynamic range; and a second color space converter configuredto convert the nonlinearized color space signals to display domainsignals; wherein the color volume transformer: loads a plurality offirst registers, prior to a first time period, with the dynamic colortransform metadata associated with a first video frame of the sourcevideo; processes first frame data corresponding to the first video frameof the source video during the first time period using the dynamic colortransform metadata associated with the first video frame of the sourcevideo loaded in the plurality of first registers; and loads a pluralityof second registers, during the first time period, with the dynamiccolor transform metadata associated with a second video frame of thesource video; wherein the color volume transformer: processes secondframe data corresponding to the second video frame of the source videoduring a second time period that is after the first time period, usingthe dynamic color transform metadata associated with the second videoframe of the source video loaded in the plurality of second registers;and loads the plurality of first registers, during the second timeperiod, with the dynamic color transform metadata associated with athird video frame of the source video; wherein the color volumetransformer switches from processing of video data corresponding to thefirst video frame of the source video to processing of video datacorresponding to the second video frame of the source video in responseto frame boundary; wherein the color volume transformer includes aplurality of circuits that operate in a pipelined configuration undercontrol of a pixel clock, and wherein the frame boundary is determinedbased on processing of the last pixel of the first video frame; whereinthe plurality of circuits of the color volume transformer switch fromprocessing of the video data corresponding to the first video frame ofthe source video to processing of the video data corresponding to thesecond video frame of the source video in response to the frameboundary, at staggered times in accordance with the pipelinedconfiguration; wherein the color volume transformer includes: a thirdcolor space converter configured to that apply gamut shaping to thelinearized color space signals in accordance with the dynamic colortransform metadata to generate gamut shaped components; a first tonemapper configured to apply first tone mapping by scaling the gamutshaped components in accordance with the dynamic color transformmetadata to generate first mapped components; a fourth color spaceconverter configured to color converts the first mapped components inaccordance with the dynamic color transform metadata to generate colorremapped components; a second tone mapper configured to apply secondtone mapping by scaling the color remapped components in accordance withthe dynamic color transform metadata to generate second mappedcomponents; and a fifth color space converter configured to colorconverts the second mapped components in accordance with the dynamiccolor transform metadata to generate the master adjusted color spacesignals.
 2. The dynamic range converter of claim 1 wherein the firsttone mapper operates in accordance with the dynamic color transformmetadata to: generate a weighted maximum of the gamut shaped components;index the weighted maximum to a piecewise linear lookup table to obtaina scale factor for each of the gamut shaped components; and multiply thescale factor by a corresponding one of the gamut shaped components togenerate the first mapped components.
 3. The dynamic range converter ofclaim 1 wherein the second tone mapper operates in accordance with thedynamic color transform metadata to: generate a weighted maximum of thecolor remapped components; index the weighted maximum to a piecewiselinear lookup table to obtain a scale factor for each of the colorremapped components; and multiply the scale factor by a correspondingone of the color remapped components to generate the second mappedcomponents.
 4. The dynamic range converter of claim 1 wherein thelinearizer and nonlinearizer are responsive to first configuration datato selectively operate in a first mode of operation where the sourcedynamic range is a high dynamic range and the display dynamic range is astandard dynamic range are further responsive to second configurationdata to selectively operate in a second mode of operation where thesource dynamic range is a standard dynamic range and the display dynamicrange is a high dynamic range.
 5. The dynamic range converter of claim 1wherein the transfer function is one of: a electro-optical transferfunction or a gamma function, and the inverse transfer function is acorresponding one of: an inverse of the electro-optical transferfunction or an inverse of the gamma function.
 6. A method comprising:converting a source color space of a source video having a sourcedynamic range to nonlinear color space signals; converting the nonlinearcolor space signals to linearized color space signals having a masteringdynamic range via a piecewise linear interpolation of a transferfunction; color volume transforming the linearized color space signalson a frame by frame basis, based on dynamic color transform metadataassociated with the source video, to generate master adjusted colorspace signals; delinearizing the master adjusted color space signals tononlinearized color space signals via a piecewise linear interpolationof an inverse transfer function in accordance with a display dynamicrange; and converting the nonlinearized color space signals to displaydomain signals; wherein the color volume transforming includes: loadinga plurality of first registers, prior to a first time period, with thedynamic color transform metadata associated with a first video frame ofthe source video; processing first frame data corresponding to the firstvideo frame of the source video during the first time period using thedynamic color transform metadata associated with the first video frameof the source video loaded in the plurality of first registers; andloading a plurality of second registers, during the first time period,with the dynamic color transform metadata associated with a second videoframe of the source video; wherein the color volume transforming furtherincludes: processing second frame data corresponding to the second videoframe of the source video during a second time period that is after thefirst time period, using the dynamic color transform metadata associatedwith the second video frame of the source video loaded in the pluralityof second registers; and loading the plurality of first registers,during the second time period, with the dynamic color transform metadataassociated with a third video frame of the source video; wherein thecolor volume transforming switches from processing of video datacorresponding to the first video frame of the source video to processingof video data corresponding to the second video frame of the sourcevideo in response to frame boundary; wherein the color volumetransforming operates via a plurality of circuits in a pipelinedconfiguration under control of a pixel clock, and wherein the frameboundary is determined based on processing of the last pixel of thefirst video frame, wherein the plurality of circuits switch fromprocessing of the video data corresponding to the first video frame ofthe source video to processing of the video data corresponding to thesecond video frame of the source video in response to the frameboundary, at staggered times in accordance with the pipelinedconfiguration; wherein the color volume transforming further includes:applying gamut shaping to the linearized color space signals inaccordance with the dynamic color transform metadata to generate gamutshaped components; applying first tone mapping by scaling the gamutshaped components in accordance with the dynamic color transformmetadata to generate first mapped components; color converting the firstmapped components in accordance with the dynamic color transformmetadata to generate color remapped components; applying second tonemapping by scaling the color remapped components in accordance with thedynamic color transform metadata to generate second mapped components;and color converting the second mapped components in accordance with thedynamic color transform metadata to generate the master adjusted colorspace signals.